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Abstract — In most manufacturing industries; demand 
uncertainty affects effective planning and control of 
production levels that maximize profits. In this paper, a new 
mathematical model is developed to optimize economic 
production quantity (EPQ) of a single-item, finite horizon, 
periodic review inventory problem with Markovian demand. 
In this model, sales price and inventory replenishment periods 
are uniformly fixed over the planning horizon. Adopting a 
Markov decision process approach, the states of a Markov 
chain represent possible states of demand for the inventory 
item. The production cost, holding cost, shortage cost and 
sales price are combined with demand and inventory positions 
to generate the profit for the decision problem. The objective 
is to determine in each period of the planning horizon an 
optimal economic production quantity so that the long run 
profits are maximized for a given state of demand. Using 
weekly equal intervals, the decisions of how much to produce 
are made using dynamic programming over a finite period 
planning horizon. A numerical example demonstrates the 
existence of an optimal state-dependent economic production 
quantity as well as the corresponding profits of item. 

Keywords — Economic Production Quantity, Markovian demand, 
Profits 

1. INTRODUCTION 

In production-inventory management, the zeal for 
manufacturing industries to plan for optimal production levels 
that sustain random demand leaves a lot to be desired. In 
practice, when production exceeds quantity demanded, 
inventory carrying costs accumulate which affect profit margins 
of the manufacturer. Similarly, production levels below demand 
impose shortage costs and loss of good will from potential 
customers. Both cases drastically reduce profit margins unless 
proper planning and coordination is put in place to establish 
optimal production levels in a given manufacturing industry. In 
an effort to achieve this goal, two major problems are usually 
encountered: 

(i) Determining the economic production quantity (EPQ) of the 
item in question 

(ii) Determining the optimal profits associated with the 
economic production quantity(EPQ) when demand is uncertain. 
In this paper, a production-inventory system is considered 
whose goal is to optimize the economic production quantity 
(EPQ) and profits associated with producing and holding 
inventory of an item. At the beginning of each period, a major 
has to be made: namely whether to produce additional units of 
the item in inventory or cancel production and utilize the 



available units in inventory. In either case, the economic 
production quantity (EPQ) must be determined that optimize 
profits in a given production-inventory system. 

According to Goya[l],the EPQ may be computed each time a 
product is scheduled for production when all products are 
produced on a single machine. The distribution of lot size can 
be computed when the demand for each product is a stochastic 
variable with a known distribution. The distribution is 
independent for non-overlapping time periods and identical for 
equal time epochs. In related work by Khouja[2],the EPQ is 
shown to be determined under conditions of increasing demand, 
shortages and partial backlogging. In this case the unit 
production cost is a function of the production process and the 
quality of the production process deteriorates with increased 
production rate.Tabucanno and Mario [3] also presented a 
production order quantity model with stochastic demand for a 
chocolate milk manufacturer. In this paper, production planning 
is made complex by the stochastic nature of demand for the 
manufacturer's product. An analysis of production planning via 
dynamic programming approach shows that the company's 
production order variable is convex. 

In the article presented by Kampf and Kochel[4], the stochastic 
lot sizing problem is examined where the cost of waiting and 
lost demand is taken into consideration. In this model, 
production planning is made possible by making a trade-off 
between the cost of waiting and the lost demand. 

The four models presented have some interesting insights 
regarding economic production quantity in terms of 
optimization and stochastic demand. However, profit 
maximization is not a salient factor in the optimization models 
cited. 

2. MODEL FORMULATION 

2.1 Notation and Assumptions 

i,j = States of demand 

N 2 ;; = Number of customers 

z 

D jj = Quantity demanded 
F = Favorable state 
U = Unfavorable state 

I Z jj = Quantity in inventory 

n,N = Stages 

P z ij = Profits 

Z = Production lot sizing policy 
V z = Expected profits 
N z = Customer matrix 

a z = Accumulated profits 

D z = Demand matrix 

c„ = Unit production cost 

I = Inventory matrix 
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Unit holding cost 
Profit matrix 
c s = Unit shortage cost 
Q z =Demand transition matrix 
Q Z ij= Demand transition probability 
p s = Unit sales price 
E z = Economic Production Quantity 
i,je{F,U} Ze{0,l} n= 



1,2,. 



.N 



We consider a production-inventory system of a single item 
whose demand during a chosen period over a fixed planning 
horizon is classified as either Favorable (state F) or 
Unfavorable (state U) and the demand of any such period is 
assumed to depend on the demand of the preceding period. The 
transition probabilities over the planning horizon from one 
demand state to another may be described by means on a 
Markov chain. Suppose one is interested in determining the 
optimal course of action, namely to produce additional units of 
item (a decision denoted by Z=l) or not to produce additional 
units (a decision denoted by Z=0) during each time period over 
the planning horizon where Z is a binary decision variable. 
Optimality is defined such that the maximum expected profits 
are accumulated at the end of N consecutive time periods 
spanning the planning horizon. In this paper, a two -period 
(N=2) planning horizon is considered. 

2.2 Finite dynamic programming formulation 

Recalling that the demand can be in state F or in state U, the 
problem of finding an optimal economic production quantity 
may be expressed as a finite period dynamic programming 
model. 

Let g n (i) denote the expected total profits accumulated during 

periods n,n+l, ,N given that the state of the system at the 

beginning of period n is ie{F,U}.The recursive equation 
relation g n and g n+ i is 

g^i) = maj; z [Qf F (P? F + g„u(F)),Q$j(P$j + 9n+i(U))] (1) 

is{F,U} ,n=l,2, N together with the final 

conditions 9N+l( F ) = 9«+l(U) = 0 

This recursive relationship may be justified by noting that the 
cumulative total profits P Z j+ g n+ i(j) resulting from reaching 
je{F,U }at the start of period n+1 from state is{F,U}at the start 
of period n occurs with probability Q Z j 



Clearly, V = CT (P^) 1 , Ze {0,1} (2) 
where "T" denotes matrix transposition, and hence the dynamic 
programming recursive equations 



9n(i) = maxz [vf+Qw ftM-i(F) + g^i(U)] 

ie{F,U} n=l,2, N-1,Ze{0,1}. 

g N (i) = max [ vf ] ie{F U} 

result where (4) represents the Markov chain stable state. 



3. COMPUTING Q z , P z andE z 



(3) 



(4) 
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The demand transition probability from state i e{F, U}to state 
js{F, U } given production lot sizing policy Ze {0,1} may be 
taken as the number of customers observed when demand is 
initially in state i and later with demand changing to state j, 
divided by the number of customers over all states. 

Q§ + (5 ) 

ie{F,U} , Ze {0,1} 

When demand outweighs on-hand inventory, the profit matrix 

P z may be computed by the relation: 

P 2 = P.ID 2 ] + + c t )(D* - I 2 ) 

Therefore 



(cp + c h + c,)(Df j -lf j ) 
p.Dt-Citf if 



(6) 



for all ij e{F,U},Ze {0,1} 

A justification for expression (6) is that D Z j -I Z y units must be 
produced in order to meet the excess demand. Otherwise 
production is cancelled when demand is less than or equal to 
on-hand inventory. The economic production quantity when 
demand is initially in state i s{F,U},given production lot sizing 
policy Ze {0,1} is 



is{F,U},Z£ {0,1} 



(7) 



The following conditions must however hold: 



E z , > 0 when D z , 



> Ij; and D = 0 when D \ < I z 



1. 

2. Z=l when c p > 0 , and Z=0 when c p = 0 

3. c s > 0 when shortages are allowed and c s = 0 when 
shortages are not allowed. 

4. COMPUTING AN OPTIMAL ECONOMIC 
PRODUCTION QUANTITY 

The optimal EPQ is found in this section for each time period 
separately, 

4.1 Optimization during period 1 

When demand is Favourable (i.e. in state F), the 
optimal production lot sizing decision during 
period 1 is 



fl if v)?> v% 
\0 if v l F <v% 



The associated total profits and EPQ are then 

r v l F i f Z = l 
if Z = 0 

and 

^ = HDff ~ Iff) + (Dfu ~ Ifu) if Z = l 
F \ 0 t/ z=o 



respectively. Similarly, when demand is Unfavorable (i.e. in 
state U), the optimal production lot sizing policy during period 
1 is 



ri if vh>v$ 
\o if t&<4 
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In this case, the associated total profits and EPQ are 

■Mis::: 

and 

~z _ I(Duf - Iuf) + (Duu ~ Ibv) if Z = 1 
0 if z = o 

respectively. 

4.2 Optimization during period 2 

Using dynamic programming recursive equation (1), and 
recalling that a z ; denotes the already accumulated profits at the 
end of period 1 as a result of decisions made during that 
period,it follows that: 

af =vf+ Cfemax[v l F , v%] + ^mai[^, i£] 
= v?+<&9l(F) + Qb9dU) 

Therefore when demand is favorable (i.e. in state F), the 
optimal production lot sizing decision during period 2 is 

„ _ Jl if a F > a F 
\0 if a l F < a F 

while the associated total profits and EPQ are 

«*>-{% ifzZl 

and 



)Jy — Iff) + (Dfu ~ ?fu) if Z = 1 
0 if Z = 0 
Similarly, when demand is Unfavorable (i.e. in state U), the 
optimal production lot sizing policy during period 2 is 



fl if ah><& 

\o if 4j < 4j 

while the associated total profits and EPQ are 



and 



rrz _ HD l UF - I l OF ) + (Dbu ~ Ibv) if 
0 if Z = Q 



Z = l 



5. CASE STUDY 

In order to demonstrate the use of the model in §2-4, a real case 
application from Vita foam , a manufacturer of mattresses in 
Uganda is presented in this section. The demand for mattresses 
fluctuates from month to month. The company wants to avoid 
mover-producing when demand is low or under -producing 
when demand is high, and hence seeks decision support in 
terms of an optimal production lot sizing policy , the associated 
profits and specifically, a recommendation as to the EPQ of 
mattresses over a two-week period. 



ISSN:2319-6890)(online),2347-5013(print) 

01 Jan. 2015 



5.1 Data Collection 

A sample of 60 customers was used. Past data revealed the 
following demand pattern and inventory levels over the state 
transitions for twelve weeks in Tables 1 and 2 below: 
Table 1 

Customers, Demand and Inventory Levels at state-transitions 
over twelve weeks for Production Lot sizing Policy 1(Z = 1) 
State 

Transition Customers Demand Inventory 



FF 
FU 
UF 

uu 



40 
20 
10 
50 



80 
20 
120 
40 



74 
60 
60 
10 



Table 2 

Customers, Demand and Inventory Levels at state -transitions 
over twelve weeks for Production Lot sizing Policy 0(Z=0) 
State 

Transition Customers Demand Inventory 



JijL 



N 



D" 



FF 
FU 
UF 
UU 



40 
20 
10 
50 



80 
20 
120 
40 



74 
60 
60 
10 



When additional mattresses are produced (Z=l) during week 1, 



.V 1 = 



40 
10 



20 



1= rso 2oi jl= r 

[120 loj [ 



74 
60 



(,() 
10 



while if additional mattresses are not produced during week 1, 
these matrices are 



[20 40j [ 



l<i<> 



NO 



20 



10 

20 



In either case, the unit sales price(p s ) is $20.00,the unit 
production cost (c p ) is $15.00,the unit holding cost per week(c h ) 
is $0.50,and the unit shortage cost per week(c s ) is $10.00 

5.2 Computation of model parameters 

Using (5) and (6), the state transition matrix and the profit 
matrix (in thousand dollars) for week 1 are 



Q l = 



0.67 
0.17 



0.33 

II.N3 



P l = 



1.447 

0.870 



1.570 
0.035 



for the case where additional mattresses are produced during 
week 1, while these matrices are given by 



().:« 



((..jo 
0.67 



■v 



0.235 0.580 
[l.l60 0.070 

for the case when additional mattresses are not produced during 
week 1. 
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When additional mattresses are produced (Z=l), the matrices 
Q 1 and P 1 yield the profits (in thousand dollars) 
wl = (0.67)(1.447) + (0.33){1.570) =1.488 
v\ = (0.17)(0.870) + {0.83){0.035) = 0.177 

However, when additional mattresses are not produced (Z=0), 
the matrices Q° and P° yield the profits (in US dollars) 

v% = (0.50)(0.235) + <0.50){0.580) = 0.408 
,•['■ = (0.(i7)(0.07) = 0.430 

5.2 The optimal production lot sizing policy and EPQ 

Since 1.488 > 0.408, it follows that Z=l is an optimal 
production lot sizing policy for week 1 with associated total 
profits of $ 1 .488 and an EPQ of 80-74 = 6 units when demand 
is favorable. Since 0.430 > 0.177, it follows that Z = 0 is an 
optimal production lot sizing policy for week 1 with associated 
total profits of $0,430 and an EPQ of 0 units when demand is 
unfavorable. 

If demand is favorable, then the accumulated profits at the end 
of week 1 are 

<>\, = - ii. (.7nl 1^ - «).:i:i)ii).i:i<» = 2. i 17 

4 = 0.408 + (0.50) (1.488) + (0.50)<0.430) = 1.367 
Since 2.447 > 1 .367, it follows that Z = 1 is an optimal 
production lot sizing policy for week 1 with associated 
accumulated profits of $ 2.447 and an EPQ of 80 -74 = 6 units 
for the case of favorable demand. 

However, if demand is unfavorable, then the accumulated 
profits at the end of week 1 are 

al = 0.177 + {0.17)(1.488) + (0.83)(0.430) = 0.786 
a% = 0.430 + (0.33) (1.488) + (0.67)(0.430) = 1.209 
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Since 1.209 > 0.786, it follows that Z=0 is an optimal 
production lot sizing policy for week 2 with associated 
accumulated profits of $1,209 and an EPQ of 0 units for the 
case of unfavorable demand. 

When shortages are not allowed, the values of Z and g n (i) and 
E Z i may be computed for i e{F, U}in a similar fashion after 
substituting c s = 0 the matrix function 
P s = p s [D z ]-(c p + c h + c s )[D z -I z ] 

6. CONCLUSION 

A production -inventory model was presented in this paper. The 
model determines an optimal production lot sizing policy, 
profits and the EPQ of a given item with stochastic demand. 
The decision of whether or not to produce additional inventory 
units is modeled as a multi-period decision problem using 
dynamic programming over a finite period planning horizon. 
The working of the model was demonstrated by means of a real 
case study. 
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